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A poset is (3+l)-free if it contains no induced subposet isomorphic 
to the disjoint union of a 3-element chain and a 1-element chain. 
These posets are of interest because of their connection with inter- 
val orders and their appearance in the (3 + l)-free Conjecture of 
Stanley and Stembridge. The dimension 2 posets P are exactly the 
ones which have an associated permutation it where i -< j in P if 
and only if i < j as integers and i comes before j in the one-line 
notation of n. So we say that a permutation ir is (3 + l)-free or 
(3 + l)-avoiding if its poset is (3 + l)-free. This is equivalent to ir 
avoiding the permutations 2341 and 4123 in the language of pat- 
tern avoidance. We give a complete structural characterization of 
such permutations. This permits us to find their generating func- 
tion. 



Key words and phrases, algebraic generating function, permutation class, restricted permutation, simple 
permutation, substitution decomposition, (3 + l)-free 
AMS 1991 subject classifications. 05A05, 05A15 



1 



Counting (3 + l)- Avoiding Permutations 



2 



1. Introduction 

The permutation tt of [n] = {1, 2, . . . , n} contains the permutation a of [k] if it has a subse- 
quence of length k order isomorphic to a, and such a subsequence is called an occurrence, or 
copy, of a. For example, 7r = 391867452 (written in list, or one-line notation) contains a = 
51342, as can be seen by considering the subsequence 91672 (= 7r(2),7r(3),7r(5),7r(6),7r(9)). 
If tt does not contain a we say that tt avoids a. A permutation class, sometimes abbreviated 
to simply class, is a downset of permutations under this order; thus if C is a permutation 
class, tt G C, and tt contains a, then a G C. Every permutation class can be described by the 
minimal permutations which are not in the class. We call such a set a basis, and denote by 
Av(B) the class with basis B. 

Given a class C, we denote by C n the set of permutations in C of length n. It is natural 
to ask for the enumeration of C and this is usually answered in terms of its generating 
function, 

5>M = Y,\Cn\x n . 

TrSC n>0 

The class we will consider in this paper is motivated by ideas in the theory of posets (par- 
tially ordered sets). Call a poset (a + h)-free if it contains no induced subposet isomorphic 
to a disjoint union of an a-element chain and a 6-element chain. Fishburn [6] character- 
ized the (2 + 2)-free posets as those which could be modeled by intervals of real numbers, 
where we let [a, b] < [c, d] if and only if b < c so that [a, b] is completely to the left of [c, d] 
on the real line. He also characterized the posets which are both (2 + 2)- and (3 + l)-free 
as those interval orders where all the intervals have length one. But until more recently 
there has been no characterization of (3 + l)-free posets. These posets also come up in the 
(3 + l)-free Conjecture of Stembridge and Stanley [16]. Stanley [15] defined a symmetric 
function generalization Xq of the chromatic polynomial of a graph G. The conjecture in 
question states that if one takes the incomparability graph G of a (3 + l)-free poset (mak- 
ing two vertices adjacent in the graph if the corresponding elements are incomparable in 
the poset) and expresses Xq in the elementary symmetric function basis, then all the coef- 
ficients are nonnegative. To date there has been only partial progress on this question by 
Gasharov [7], Gebhard and Sagan [8], and Lee and Sagan [13]. 

Every permutation tt gives rise to a poset P n by letting i -< j in P n if and only if i < j 
and i appears to the left of j in tt. The posets arising this way are exactly those of dimension 

2. Call a permutation ir (3 + l)-free or (3 + l)-avoiding if its poset is (3 + l)-free. Note that 
P w = 3 + 1 precisely when tt = 2341 or 4123. So the class of (3 + l)-free permutations is 
Av(2341, 4123). In this paper we completely characterize the elements in this class. Using 
this characterization, we are able to compute the corresponding generating function. The 
hope is that this viewpoint might also be useful in making progress on the (3 + l)-free 
Conjecture in the case of dimension 2 posets. We should mention that Skandera [14] has a 
useful characterization of all (3 + l)-free posets. But his involves conditions on the entries 
of the square of the antiadjacency matrix of the poset and so seems to be quite different 
from ours. 
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Figure 1: The two simple permutations on the left are the 123-avoiding parallel al- 
ternations. The permutation shown on the right is another simple permutation in 

Av(2341,4123). 



A secondary motivation for enumerating the class Av(2341, 4123) is that it belongs to 
a family of classes which have proved to be a fertile testing ground for different enumer- 
ative techniques. For bases B consisting of a single permutation of length at most 4, exact 
enumerations for Av(B) are known except in the notable case of B = {1324} (or its sym- 
metry B = {4231}). (Here only lower and upper bounds are known, see Albert, Elder, 
Rechnitzer, Westcott, and Zabrocki [2] and Bona [5].) For bases B consisting of two per- 
mutations, exact enumerations are known in the case where one element of B has length 
at most 3 and the other has length at most 4. However, in the case where B consists of two 
permutations of length 4, much less is known. 

The permutation containment relation is invariant under the 8 symmetries generated 
by reversal, complementation, and inversion. These symmetries can be used to cut down 
the number of cases; in particular, the (2) different sets B consisting of two permutations 
of length 4 split into 56 different symmetry classes. Of these 56 essentially different classes, 
it is known that there are 38 different enumerations, which follows from a long string of 
papers [4, 9, 10, 11, 12]. Only about half of these have been enumerated. 

The approach we use here to enumerate Av(2341, 4123) is based on simple permuta- 
tions, so we briefly recall the salient definitions and properties. An interval of a permuta- 
tion 7r = 7r(l)7r(2) • • • 7r(n) is a contiguous subsequence 7r(i)7r(z + 1) • • • n(j) whose values 
form a contiguous set of integers. If a permutation has no intervals except for itself and 
its singletons then it is said to be simple. For example, 871329456 has nontrivial intervals 
87, 132, and 456, while 31524 is simple. Figure 1 shows the plots of three further simple 
permutations; in this diagram and, in subsequent similar diagrams, the dots are placed at 
cartesian coordinates (£, vr(i)). 

Simple permutations are precisely those that do not arise from a non-trivial inflation, in 
the following sense. Let a be any permutation of length m and cti, a>2, ■ ■ ■ , a m any sequence 
of permutations. Then the inflation of a by 0.1,0.2, • • • > o m , denoted a[a±, 02, ■ ■ ■ , a m ], is the 
permutation of length \o\\ + • • • + \a m \ which decomposes into m segments ol x ol 2 • • • o' m 
where each segment ct i is an interval which is order isomorphic to Oi, and the sequence 
a\ai ■ ■ ■ a n formed by any (and hence every) choice of aj from a[ is order isomorphic to a. 
For example the inflation of 3142 by 21, 132, 1, 123 is 



3142[21, 132, 1, 123] = 87 132 9 456. 
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Figure 2: The two types of permutations in Av(123, 3412). Throughout this paper, V 
denotes the class of decreasing permutations, i.e., Av(21). 

The precise connection between simple permutations and inflations is furnished by a 
result from Albert and Atkinson [1]. 

Lemma 1.1. For every permutation tt there is a unique simple permutation a such that 



7r = a[ati,a2, ■ 



Furthermore, except when a = 12 or a = 21, the intervals of a that correspond to a\, 0*2, • • • , ct m 
are uniquely determined. In the case that a = 12 (respectively a = 21), the intervals are unique so 
long as we require the first of the two intervals to be sum (respectively, skew) indecomposable, 
which means that it cannot be decomposed further as a nontrivial inflation of 12 (respectively, of 
21). 

One important feature of Av(2341, 4123) is that it is a sum closed class, meaning that 
if a and vr lie in Av(2341, 4123) then 12[cr,vr] also lies in Av(2341, 4123). The generating 
function for any sum closed class is easily seen to be 1/(1 — g), where g is the generating 
function for the non-empty sum indecomposable permutations in the class. 

A final lemma which we use was proved by Atkinson [3]. 

Proposition 1.2. Every permutation in Av(123, 3412) is either a horizontal or vertical juxtaposi- 
tion of two decreasing permutations (see Figure 2). 



2. Categories of Simple Permutations in Av(234l,4l23) 

In this section we categorize simple permutations in Av(2341, 4123) according to whether 
they contain or avoid the permutations 123 and 3412. 

Proposition 2.1. Let a be any simple permutation of Av(2341, 4123) that contains both 123 and 
3412. Then a = 5274163. 

Proof. Consider a simple permutation a € Av(2341, 4123) that contains both 123 and 3412. 

Figure 3 shows a with the 5x5 grid defined by a copy of 3412. The unlabeled cells 
must be empty and the cells labeled V (with or without a subscript) must be decreasing; 
this is a direct consequence of the avoidance conditions. Another consequence (not shown 
in Figure 3 but shown in subsequent diagrams) is that every point in D3 is to the right of 
every point in T>\, and every point in T>2 is to the right of every point in P4. If we choose 
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Figure 3: The first structure diagram for the simple 3412-containing permutation a 6 

Av(4123,2341). 
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Figure 4: The second and third structure diagrams for the simple 3412-containing per- 
mutation a £ Av(4123, 2341). 



the copy of 3412 so that the '4' and the '1' points are as close (vertically) as possible then 
the two cells labeled Z must be empty and the cell labeled Y must be decreasing. 

However rather more can be gleaned from the vertical proximity of the '4' and '1'. 
Consider the two cells T>\ and T>2 that flank the center cell labeled Y. There can be no 
increase from T>\ to Y nor from Y to T>2 because any such increase would result in a copy of 
3412 with a closer '4' and '1'. The diagram on the left of Figure 4 displays these conditions. 
Again in this diagram all cells that are not labeled are empty and no claim is yet made 
about the four corner cells labeled Q. 

Notice that the central V cell is either empty or consists of a single point; if it were any 
larger it would comprise a non-trivial interval. Now consider the cell labeled C\ and the V 
cell to its right. If any entry in this pair of cells was larger than any entry of C2 we would 
have a copy 4123. Similarly if any entry in the cell labeled C4 or the V cell above it were to 
the right of an entry in the cell labeled C2 then we would have a copy of 2341. Therefore 
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the entries in the cell labeled C2 must lie above and to the right of all other entries in a, and 
so C2 must be empty by simplicity. Similarly, it can be seen that C3 must be empty. This 
gives the diagram on the right of Figure 4. 

In this diagram the 2x2 array of cells in the top-left cannot contain 123 (since that 
would give a copy of 2341). Similarly, the 2x2 array of cells in the bottom-right cannot 
contain 123. However, we have assumed that a contains a copy of 123. By inspection, 
this copy of 123 must be formed by an entry in D3, an entry in the central V cell (which is 
known to be at most a singleton), and an entry in D4. This, by the avoidance conditions, 
implies that the cells labeled C\ and C4 must be empty. 

Now consider the cell in the top row labeled V. This cell cannot contain an entry to 
the left of an entry in the P3 cell because that would create a copy of 4123, so all of the 
entries in this cell must lie to the right of all of the entries in V3. However, if there are any 
such entries, then they would form an interval with the '4' of the identified copy of 3412, 
so the V cell in the top row must be empty. Similarly, it can be seen that the three other 
peripheral V cells are empty. By simplicity it then follows that the cells labeled T>\ and T>2 
must be empty and that P3 and V4 must be singletons. This shows that a = 5274163, as 
desired. □ 

Corollary 2.2. If a is a simple permutation in Av(2341, 4123) then either 

1. a contains 123 hut not 3412, 

2. a contains 3412 hut not 123, 

3. a contains both 123 and 3412 and is the permutation 5274163, 

4. a contains neither 123 nor 3412. There are exactly two such permutations of this type of 
every even length n > 4. 

Proof. The final alternative is the only one that does not follow directly from Proposi- 
tion 2.1. However the form of permutations in Av(123, 3412) is given in Proposition 1.2. 
Such a permutation can be simple only if the two decreasing sequences shown in that 
proposition exactly interlace and the permutation neither begins with its largest entry nor 
ends with its smallest entry. Hence the permutation must have even length and there is 
one such for each lengfor each of the two forms in Proposition 1.2. □ 

3. The Structure of Simple Permutations in Av(234l, 4123, 3412) 

We now work towards a description of the simple permutations in Av(2341, 4123, 3412). 
The following result, which actually holds for all permutations in this class, is a stepping 
stone towards that goal. 

Proposition 3.1. Every permutation ir e Av(2341, 4123, 3412) in which the greatest entry pre- 
cedes the least entry has one of the two forms shown in Figure 5. 
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Figure 5: The two types of permutation in Proposition 3.1. As usual, cells labeled by 
V represent decreasing sequences. 
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Figure 6: Structure diagrams for a permutation in Av(2341, 4123, 3412) in which n 
precedes 1 but n is not the first entry and 1 is not the last entry. 



Proof. Consider an arbitrary permutation ir G Av(2341, 4123, 3412) of length n in which n 
precedes 1. If either n is the first entry or 1 is the final entry, then the remainder of ir avoids 
123 and 3412, and the result follows from Proposition 1.2. Suppose now that n is not the 
first entry of 7r and that 1 is not the last entry of n. Because 7r avoids 3412, this implies that 
7r(l) < 7r(n), giving the situation depicted on the left of Figure 6. 

From the fact that ir avoids 2341, we see that the cells labeled C\ and C2 must be empty, 
while the cell D\ must be decreasing. Using the 4123 avoidance of 7r, we see that the cells 
labeled C3 and C4 must be empty, while the cell D2 must be decreasing. This gives the 
center diagram of Figure 6. 

The 2341-avoidance proves that the region YUZ is decreasing, while the 4123-avoidance 
proves that X U Y is decreasing. If the entire region X U Y U Z is decreasing then ir has the 
structure shown on the left of Figure 5, and we are done. 

So suppose to the contrary that X U Y U Z is not decreasing. Then cell Y must be 
empty. Furthermore, the first (and largest) point of cell X must precede the last (and 
smallest) point of cell Z and it follows from the 2341, 4123-avoidance again that the cell 
X and the cell labeled V to its left must form a single decreasing sequence, as must the cell 
Z and the cell labeled V to its right. The permutation ir is therefore a vertical juxtaposition 
of decreasing sequences, which is the structure on the right of Figure 5, completing the 
proof. □ 

Corollary 3.2. Every permutation of length n in Av(2341, 4123, 3412) whose first entry is greater 
than its last entry has one of the forms of Figure 7. 
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Figure 7: The two types of permutation in Corollary 3.2. 



Proof. The permutations of the corollary are the inverses of the permutations of Proposi- 
tion 3.1. The result follows because inversion is represented by reflection of permutation 
diagrams about the southwest-northeast diagonal and Av(2341, 4123, 3412) is closed under 
taking inverses. □ 

The previous two results have described very restricted subsets of Av(2341, 4123, 3412). 
We now broaden our study to consider arbitrary permutations in this class. Recall that the 
entry n(j) of ir is a left-to-right maxima (l-r max for short) if ir(j) > n(i) for all i < j, and a 
right-to-left minima (r-l min for short) if ir(j) < ir(k) for all k > j. It is convenient to connect 
the l-r maxes and connect the r-l mins by axes-parallel paths as depicted in Figure 8. In this 
relative extrema diagram the entries of the permutation are depicted by circles as usual while 
the squares denote inflections in the axes-parallel paths. From the definition of l-r maxes 
and r-l mins, it follows that there are no entries above the l-r max path and no entries below 
the r-l min path. 

In our situation there are strong conditions on the interaction between the l-r maxes 
and the r-l mins. 

Lemma 3.3. If it G Av(2341, 4123, 3412) is sum indecomposable then the inflection points form 
an increasing sequence in which the inflections associated with the l-r maxes alternate with the 
inflections associated with the r-l mins. 

Proof. The inflections associated with the l-r maxes are all increasing by definition, as are 
the inflections associated with the r-l mins. To show that their union is increasing we just 
have to show that neither of the two situations on the left of Figure 9 can arise. 

The first situation in Figure 9 cannot arise, because it contains 3412. Now suppose that 
the second situation of Figure 9 occurs in one of these permutations. The inflection in the 
lower-right position comes from the l-r max path, so ir cannot contain any entries above 
this path. Similarly, 7r cannot contain any entries below the r-l min path. This implies that 
7r must be sum decomposable, which is a contradiction. 
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Figure 8: L-r maxes and r-1 mins in an arbitary permutation, connected by axes-parallel 
paths. 




Figure 9: Four illegal configurations for a permutation in Av(2341, 4123, 3412). 
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Figure 10: One of two possible interactions of 1-r maxes and r-1 mins in a permutation 
whose inflection points satisfy the conditions of Lemma 3.3. 



It remains to show that the two types of inflection alternate. Essentially, the only way 
this property can fail is if the permutation contains the third or fourth situation from 
Figure 9. Both of these situations contain a copy of either 2341 or 4123, completing the 
proof. □ 

This lemma holds, of course, for all simple permutations in Av(2341, 4123, 3412) (of 
length more than 2) and we now build on it to pin down the structure of such permuta- 
tions. Figure 10 shows one of the two ways in which the 1-r maxes can interact with the r-1 
mins in such a simple permutation. In this figure the leftmost inflection is associated with 
the 1-r maxes; the other way is where the leftmost inflection is associated with the r-1 mins 
and the two types are related by inversion. 

Figure 10 shows the permutation partitioned into cells: these cells are called corner cells 
if they abut a 1-r max or a r-1 min, and central cells otherwise. Successive corner cells, except 
for the first two and final two, are always separated by a central cell. As we shall soon see 
there are strong dependencies between consecutive cells. 

In such a simple permutation, consider any four points consisting of two consecutive 
1-r maxes and two consecutive r-1 mins whose associated inflection points are also consec- 
utive, together with the set of points of the permutation contained within the rectangle 
they define. There are two possible ways for the two 1-r maxes to interleave with the two 
r-1 mins (as a 2413 or as a 3142), and in each case the subpermutation in the rectangle they 
define is of one of the types considered in Proposition 3.1 or Corollary 3.2. Therefore the 
possible forms for the subpermutation are as shown in Figure 11. Following our conven- 
tions, the empty regions in these diagrams are empty. Also, because of simplicity, a central 
cell labeled V must be either empty or a singleton. 

We call the rectangles of Figure 11 formed from the 1-r maxes and r-1 mins of a sim- 
ple permutation in Av(2341, 4123, 3412) the "tiles" of the permutation, and we say that 
each tile is of type 2413 or 3142 (the type being determined by the relative order of the 
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Figure 11: The possible forms of the rectangles defined by two consecutive 1-r maxes 
and two consecutive 1-r mins in a simple permutation in Av(2341, 4123, 3412). 



four extremal entries). The whole permutation is then a union of overlapping, alternating 
tiles (overlapping in strips and alternating in type). Since we know the structure of the 
tiles and that they must fit together with compatible intersections we can deduce strong 
consequences for the cells of a permutation. 

To give suggestive names to the tiles in Figure 11 call the diagrams in the first row _l 
and _J left-to-right. Similarly call the second row diagrams I - and F . 

Theorem 3.4. A simple permutation tt of length more than 2 lies in Av(2341, 4123, 3412) if and 
only if it satisfies the following four conditions. 

(a) The inflection points form an increasing sequence in which the inflections associated with the 
l-r maxes alternate with the inflections associated with r-l mins. 

(b) The corner cells of it are decreasing. 

(c) Every pair of consecutive corner cells either form a decreasing sequence or interlace as a 
parallel alternation in the sense of Figure 1 

(d) A non-empty corner cell interlaces with either the previous or next corner cell, but not both. 

(e) A central cell s contains at most one element. If the two corners adjacent to it interlace then 
s is empty; otherwise these two cells together with sform a decreasing sequence. 

Proof. We first prove that every simple permutation in Av(2341, 4123, 3412) satisfies (a)- 
(e), beginning by observing that (a) is a direct consequence of Lemma 3.3. By (a), the graph 
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of tt can be decomposed into tiles of one of the four forms shown in Figure 11. All corners 
in these tiles are decreasing, so (b) must hold. 

To prove (c) consider any two consecutive corner cells. We shall assume that they are 
neither the first nor last pair of corner cells (these exceptional cases are treated by an almost 
identical argument). The two corner cells are separated by some central cell and lie in a tile 
in which they are the second and third corners of the tile. If the tile is of type For J then 

these cells form a decreasing sequence. If the tile is of type I or I then they must interlace 

as a parallel alternation for otherwise one of the cells will contain two elements forming 
a block or a single element forming a block with the 1-r max or r-1 min on its boundary 
which contradicts simplicity. 

To prove (d) let A, B, C be 3 consecutive corner cells with the middle cell B non-empty. 
Consider a tile containing them whose first three corner cells correspond to A,B,C (the 
case where the last three corner cells of the tile correspond to A, B, C is similar). If this 

tile is of type I or I then A U B is decreasing while, by the argument of (c), B and C 

interlace. If the tile is of type F or J then BuCis certainly decreasing. But, if A U B is 
also decreasing then B, together with its abutting extremal point, would be a non-trivial 
interval of tt contradicting simplicity. 

For the proof of (e) note first that every central cell s of tt is the central cell of some 
tile and we have already observed that such central cells have at most one point. If the 

adjacent corner cells of this tile interlace then the tile has type I or I and so s is empty. 

Otherwise the adjacent corners form a decreasing sequence and (if this is non-empty) the 
tile has type F or _J in which case the corners also form, together with s, a decreasing 
sequence. 

For the converse let tt be any permutation satisfying (a)-(e). Condition (a) shows that 
the 1-r maxes and r-1 mins of tt or tt^ 1 interlace as shown in Figure 10 and conditions (b)- 
(e) show that the permutation is an overlapping union of the tiles shown in Figure 11. 

If tt contains a copy of 2341 then, by replacing the '1' in this copy by a subsequent 
smaller point if necessary, we may take the 'V to be a r-1 min. Then (see Figure 10) the 
points corresponding to the '2', '3', and '4' must lie in the 4 or 5 cells that contain points 
before and larger than the 'V. In particular a copy of 2341 is contained in a tile and, from 
the form of the tiles, this is impossible. Thus tt avoids 2341 and, by a similar argument also 
avoids 4123. 

Suppose now that tt contains a copy of 3412. The '3' in this copy must be contained in 
a cell associated with a 1-r max because points in other types of cell are never followed by 
a smaller increasing pair of points. The '4' in this copy is not contained in the same cell as 
the '3' nor in the immediately succeeding central cell (since, from the form of the tiles, the 
entries in adjacent cells form a decreasing sequence). Hence the only location where the 'V 
and '2' can be situated is in the corner cell following the one that contains the '3', but that 
is impossible as cells are decreasing. 

To show tt is simple, we again seek a contradiction and suppose that it contains a non- 
trivial block B. The subsequence of tt consisting of all 1-r maxes and all r-1 mins is iso- 
morphic to a simple permutation (see Figure 10). So if B contains more than one point of 
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this subsequence it must contain every point and we would have B = ir which contradicts 
nontriviality. Otherwise B must be contained in a tile, but the tiles themselves are easily 
seen to be simple. This final contradiction finishes the proof of the converse. □ 

4. Enumeration of simple permutations in Av(234l, 4123, 3412) 

As we saw in the previous section simple permutations in Av(2341, 4123, 3412) of length 
more than 2 have their leftmost inflection point associated with either a 1-r max or a r-1 
min and, as these two types are related by an inversion, there are equal numbers of each 
in every length. So we shall enumerate those whose leftmost inflection is associated with 
a 1-r max and then double the result. 

We shall obtain the generating function of this set as a sum of terms, with a typical 
term counting simple permutations in which there are n extremal points (and therefore 
n corner cells), a fixed set of k interlacing corner pairs, and t central cells (lying between 
non-interlacing corner cells) that can have or 1 point. The set of simple permutations of 
such a type is enumerated by the generating function 

x n y k z t (1) 

where y = x 2 /(l — x 2 ) and z = 1 + x. This is because every interlacing pair of corner cells 
contributes some positive even number of points to the permutation while each central cell 
between non-interlacing corners contributes or 1 point to the permutation. 

Note that there are n — 3 central cells because there is no central cell between the first 
and last pairs of corner cells. So the value of t depends on whether the first pair of corner 
cells and the last pair are among the set of k interlacing pairs. There are 3 different cases: 

1. Both the first and last pairs of corner cells interlace. Here t = n— 3— (k— 2) = n—k—1. 

2. Only the first pair or the last pair of corner cells interlaces. Here t = n — 3 — (k — 1) = 

n — k — 1. 

3. Neither the first or the last pairs of corner cells interlace. Here t = n-3 — k = n-k — 3. 

To find the number of choices for the k interlacing pairs of corner cells in each of these 
4 cases we make use of the following well known result. 

Lemma 4.1. The number of ways of picking t non-overlapping pairs + I) from {1, . . . , m} is 




In the first case of the above 3 possibilities two of the k pairs are already chosen and 
the remaining k — 2 pairs have to be chosen from the interior n — 4 corner cells: this can 
be done in ( n _4 fc ^2~ 2 ' ) ) ways by the previous lemma. Similarly the second and third cases 
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give, respectively, 2( n-3 ? 7^~ 1 - ) ) and ( n ^ fc ) choices for selecting the k interlacing pairs of 
corner cells. 

Hence, for fixed n, the sum of all the terms in expression (1) over all choices of k inter- 
lacing corner pairs is 

n — k — 2\ n f n — k — 2\ k _ 2 (n — k — 2\ k _ 3 \ k 



t-2 r +2 l *-i r H k 

So we need to sum the above expression over n > 4 (since there are no simples for 
n < 3) and k > 0. This double summation is first summed over n using the binomial 
expansion and then over fcasa geometric series (taking care of the boundary cases k = 
and k = 1 separately). The end result is 

x 4 z x 4 y 2x 4 yz ^ x 4 y 2 z(l — xz + x) 2 



1 — xz (1 — xz) 2 1 — xz (1 — xz) 2 (l — xz — x 2 yz) 
Expressing this in terms of x and, multiplying by 2, we obtain 

Theorem 4.2. The generating function for simple permutations of length greater than or equal to 
4 in Av(2341, 4123, 3412) is 

2(x A + x 6 + x 9 ) 
(1 -x 2 )(l -2x + x 3 -x 4 ) 



5. The enumeration of Av(2341,4123) 

We now only have to assemble the pieces we have developed. We begin by determining 
the allowed inflations in this class. 

Proposition 5.1. Let a G Av(2341, 4123) be a simple permutation of length m > 4. The inflation 
a[ai, . . . , a m ] lies in Av(2341, 4123) if and only if every on is a decreasing sequence. 

Proof. First, if each oti is decreasing then any copy of 2341 or 4123 in a[a\, . . . , a m ] could 
contain at most one entry from each oti, which is impossible because a itself avoids 2341 
and 4123. 

Now take a[a\, . . . , a m ] G Av(2341, 4123) and suppose to the contrary that a, L contains 
12 for some index i. Then a(i) must not be the '2' or the '3' in a copy of 231 (in a), because 
that would lead to a copy of 2341 in a[a\, . . . , a m ]. Similarly, a(i) is neither the '1' nor the 
'2' in a copy of 312. Because a(i) is not the '2' in a copy of 231, the entries of a to the right of 
a(i) must consist of a series of entries below a(i) followed by a entries of terms above cr(z'). 
The other three conditions imply similar restrictions on the entries below <t(i), the entries 
to the left of cr(i), and the entries above a(i). These restrictions are displayed in Figure 12 
(following our conventions, unlabeled cells are empty in this diagram) which shows that 
<7 is sum decomposable if either W or Z is non-empty or skew decomposable if W and Z 
are both empty; in particular a is not simple. □ 
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Figure 12: The situation in the proof of Proposition 5.1: a{i) is not the '2' or '3' in a 
copy of 231, nor the '2' in a copy of 312, nor the '1' in a copy of 312. 

Because Av(2341,4123) is sum closed, its generating function, which we label /, sat- 
isfies / = 1/(1 — g), where g denotes the generating function for nonempty sum inde- 
composable permutations in the class. Therefore we need only determine g. Because we 
will often be inflating permutations by decreasing sequences, it is convenient to define 
d = x/(l — x). Using Corollary 2.2 the set of nonempty sum indecomposable permutations 
in Av(2341, 4123) is then the union of 

(i) . the permutation 1, 

(ii) . inflations of 21 by permutations in Av(123), where the first entry is inflated by a skew 

indecomposable permutation, 

(iii) . inflations of simple permutations of length at least 4 in Av(123) = Av(2341, 4123, 123) 

by decreasing sequences, 

(iv) . inflations of simple permutations of length at least 4 in Av(2341, 4123, 3412) by de- 

creasing sequences, and 

(v) . inflations of 5274163 by decreasing sequences. 

These sets are disjoint except for an intersection between those of types (iii) and (iv). This 
intersection consists of the inflations of 123-avoiding parallel alternations (see Figure 1), of 
which there are two of every even length, so we have 

2d 4 

g.f. for (iii) n (iv) = - - 

Notice that the sets of type (i)-(iii) together comprise the set of non-empty sum inde- 
composable permutations of Av(123). As every permutation is either sum indecompos- 
able or sum decomposable, we can obtain the generating functions of these permutations 
by subtracting the generating function of sum decomposable permutations from the gen- 
erating function for the non-empty permutations of Av(123). The sum decomposable per- 
mutations in Av(123) are inflations of 12 by decreasing sequences, so we see 

g.f. for (i)-(iii) = c — d 2 , 
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where c = (1 — 2x — \/l — Ax) /(2x) is the generating function for the non-empty permuta- 
tions in Av( 123). 

Finally, Theorem 4.2 gives us the generating function for sum indecomposable permu- 
tations of type (iv): 

, , ,. , 2(d 4 + d 6 + d 9 ) 

gi - f ° r (1V) = (1-<P)(1- 2d + 

and sum indecomposable permutations of type (v) are counted by d 7 . 
Putting all these expressions together gives 

Theorem 5.2. The generating function f for Av(2341, 4123) has the form f = 1/(1 — g) where 



_{l-2x-y/l-Ax) 
9 ~ 2x 

(1 - 13x + 74x 2 - 247x 3 + 539x 4 - 805x 5 + 834x 6 - 595x 7 + 283x 8 - 80x 9 + 8x 10 )x 2 
(1 - x) 7 (l - 2x)(l - 6x + 12x 2 - 9x 3 + x 4 ) 

Further calculations with a computer algebra package such as Singular shows that / 
satisfies the quadratic 



(I44x 25 - 3524x 24 + 38648x 23 - 259931x 22 + 1231750x 21 - 4420385x 20 + 12533805x 19 
-28844031x 18 + 54839380x 17 - 87179343x 16 + 116833299x 15 - 132706667x 14 
+128169929x 13 - 105396633x 12 + 73761400X 11 - 43835832x 10 + 22029889x 9 
-9301917x 8 + 3269458x 7 - 944215x 6 + 220007x 5 - 40293x 4 + 5578x 3 - 548x 2 
+3Ax - 1) f 

+ (-48x 25 + 1380x 24 - 17556x 23 + 134339x 22 - 708318x 21 + 2775400x 20 - 8464162x 19 
+20701382x 18 - 41428652x 17 + 68785738x 16 - 95667058x 15 + 112183057x 14 
-111372132X 13 + 93798415x 12 - 67025068X 11 + 40562377x 10 - 20710152x 9 + 8865879x 5 
-3153464x 7 + 920002x 6 - 216192x 5 + 39867x 4 - 5548x 3 + 547x 2 - 34a; + l) / 

+ (4x 25 - 132x 24 + 1921x 23 - 16624x 22 + 97464x 21 - 416740x 20 + 1361690x 19 

-3508914x 18 + 7290078x 17 - 12404442a; 16 + 17480077x 15 - 20556472x 14 + 20271017a; 13 
-16800814x 12 + 11703343X 11 - 6835800x 10 + 3331377x 9 - 1343826x 8 + 443390x 7 
-117616x 6 + 24459x 5 - 3838x 4 + 427x 3 - 30a; 2 + x) 

= 0. 

The growth rate of the class C is the limit of y/\C^\ as n — > oo (if this limit exists). In 
our case, this is the reciprocal of the least positive root of the discriminant of the minimal 
polynomial above, which is 4, the same as the growth rate of Av(123). 
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